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Abstract. This paper presents a new method to solve functional equations of mul- 
tivariate generating functions, such as F(r, s) = e(r, s)+xf(r, s)F(l, l)+xg(r, s)F(qr, 1)- 
xh(r, s)F(qr, qs), giving a formula for F(r, s) in terms of a sum over finite sequences. 
We use this method to show how one would calculate the coefficients of the gen- 
erating function for parallelogram polyominoes, which is impractical using other 
methods. We also apply this method to answer a question from fully commutative 
afhnc permutations. 
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^ ; 1. Introduction 

Some generating functions are most naturally defined by a functional equation; in 
this article, we discuss a new method for solving certain functional equations involving 
multiple variables. 

J ■ We set the stage with an elementary example: there are many families of combina- 

torial objects (binary trees, Dyck paths, triangulations of convex polygons, and many 
more; see [Stall] ) whose generating function satisfies the functional equation 

C{x) = l + xC{x) 2 . 

The generating function C(x) = ^2 n>0 

CfiOC IS el formal power series in one variable 
x that marks some statistic (often size) on the family of combinatorial objects. We 
can interpret the above equation to mean that every object in the family can either 
be represented as an object of size zero (an empty object) or as being composed of 
two smaller objects from the family. The solution to the above equation is 

c{x) = — 2x — ' 

and the coefficients of the power series expansion of this generating function are 
the Catalan numbers. This gives a conceptual reason for the prevalence of Catalan 
■ numbers in combinatorics. 

When we investigate multiple statistics at the same time, the functional equations 
can become more complicated. Suppose we are trying to solve for the generating 
function F(s, t, x, y, q) that satisfies a functional equation of the type 

(1.1) F(s) = xe{s) + xf{s)F{l) + xg{s)F{qs). 

Here we have suppressed the variables t, x, y, and q to simplify the notation; the 
reader should interpret F(sq) as F(sq,t,x,y,q). In addition, the functions e, /, and 
g may be formal power series in all the variables. The combinatorial significance of 



2010 Mathematics Subject Classification. Primary 65Q20, 05A15; Secondary 05A05, 05B50, 
05C38, 05E15. 

Key words and phrases, functional equation, functional recurrence, combinatorial statistic, par- 
allelogram polyomino, staircase polyomino, afhne permutation, fully commutative. 

1 



2 



MICHAEL CHON, CHRISTOPHER R. H. HANUSA, AND AMY LEE 



a term like F(sq) is that the statistic marked by q increases at the same time as the 
statistic marked by s as the objects are being built. 

Functional equations of this type arise naturally when enumerating with statistics 
combinatorial objects such as polyominoes [BMB09j . plane trees |BDLPP98] . lattice 
paths [BDLPP99] . and pattern-avoiding permutations |BDLPP0T] . Bousquet-Melou 
proved in |BM96l Lemma 2.3] that the solution to Equation (11 .11) is 

_ E(s) + E(l)G(s) - E(a)G(l) 
[) ~ l-G(l) 

where 

E(s) = J2 x n+1 g(s)9(sq) ■ ■ ■ g{sq n -Msq n ) 

n>0 

and 

G{s) = Y, xn+1 9(s)g(sq) ■ ■■9(sq n - 1 )f(sq n ). 

n>0 

Bousquet-Melou used this lemma, as well as a generalization involving derivatives of F 
with respect to s, to find the generating function for various classes of column-convex 
polyominoes. Bousquet-Melou and Brak's survey on enumerating polyominoes and 
polygons |BM B09j is especially recommended reading. 

Theorem 12.11 gives the solution to generating functions defined by a functional 
equation that simultaneously replaces multiple variables, such as in 

F(r, s) = e(r, s) + xf(r, s)F(l, 1) + xg(r, s)F(qr, 1) + xh(r, s)F(qr, qs). 

Our method applies to functional equations in an arbitrarily large number of formal 
variables r\ through r m and with arbitrarily many terms in the functional equation 
where each can be replaced by 1 or q^n for j > 0. 

Our proof is rather elementary — we repeatedly apply the functional equation and 
take the formal power series limit. Our main result (Theorem 12.11) is stated in terms 
of a sum over finite sequences. More importantly, in principle our method allows 
for the calculation of the coefficients of the generating function. This is in contrast 
to Bousquet-Melou's result, which gives a quotient of g-Bessel functions, both of 
which are complicated infinite sums. Our method does not replace Bousquet-Melou's 
method nor the powerful kernel method [BBMD + 02], which applies to many addi- 
tional functional equations. We refer the reader interested in other solution methods 
to Bousquet-Melou and Jehanne's [BMJ06J. 

In Section [21 we prove Theorem 12.11 and demonstrate how it applies to some simple 
functional equations including Equation (II. ip . In Section [3j we apply our method to 
the functional equation of parallelogram polyominoes and manipulate the solution to 
show how one would find the coefficients of the corresponding generating function. 
In Section m we apply a trivariate version of Theorem 12.11 to the study of fully 
commutative affine permutations, which was the original motivation for this study. 
An original analysis of fully commutative affine permutations in II 1.1 i(T| Lemma 3.12] 
involves an unwieldy ad hoc calculation that we are able to replace by working it into 
the larger framework of solving multivariate functional equations. 
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2. Main Result 

Theorem 2.1. Let F(r) be a formal power series in formal variables x, q, and r = 
ri, . . . , r m , and let 2 be a set of m-tuples j = (ji, . . . ,j m ) of integers greater than or 
equal to —1. Furthermore, let e(r) and /j(r) for all] e 3 be formal power series in the 
formal variables x, q, and r. Suppose that F(r) is defined by the functional equation 

(2.1) F(r) = e(r) + J] ^(^((frO^' , • • • , (q jm r m Y^), 

jea 

where e{j) — \ 3 — ® i Then an explicit expression for Fix) is 
(0 if j = -1 

(2.2) 

F(r) = ]T x n J2 <Q ai ' n+1 ri' n+ \ g^+V^ 1 ) U fAf^i'** ■ ■ ■ > 

n>0 J=CJ 1 ,..-J W ) i=1 

j l ea 

where the second sum is over all length n sequences J of m-tuples from 3 and where 
the exponents a^i and b k ^ depend on the sequence J as follows. 

First, define a^i = and bk,i = 1 for all 1 < k < m. Then, for 2 < % < n + 1 
and 1 < k < m, determine a^i and b^j in relation to the sequence {j\,j % 2, ■ ■ ■ , ijt-i,}- 
If —1 occurs in this sequence, define b^i = and ak,i to be the sum of the entries of 
the sequence after the last occurrence of —1; otherwise define bk,i = 1 and set a^j to 
be the sum of all entries in this sequence. 

Proof. Applying Equation (12. ip generates \3\ new occurrences of F for every initial 
occurrence of F; these new occurrences are each indexed by a j G 3 and weighted by 
x times the function f- y The only terms that do not continue to expand in successive 
applications of Equation (12. ip are those with a terminal e(r) function. As such, the 
new non-expanding terms generated by applying the functional equation an {n + 1)- 
st time consist of one term for every sequence of length n on the alphabet 3, each 
of which is multiplied by x n . Taking the formal power series limit of this iterative 
procedure, the powers of x become arbitrarily large as to cause no occurrences of F 
to remain. 

The exponents a^^ and \,i arise as the actions of F((g jl 7r) e(jl \ . . . , (q^ m r m ) e ^' m ^) 
are followed. The initial values a^i and bk,i are so defined since the first expansion is 
of F(r\, . . . , r m ). Subsequently, the precise sequence J = (j 1 , . . . , j n ) determines the 
exponents of q and the presence of the variable r^. The variable will not be present 
after f h = — 1 while the exponent of q in entry k is increased by positive resetting 
to zero when j\ — — 1. □ 

Example 2.2. We start with the simple functional equation 

F(r) = r + xF(r) + xF(qr). 

The coefficients c n ^ of the generating function F(l,x, q) = J2 c n,h xn Q h coun t the 
number of ways to produce h heads when flipping n coins. To apply Theorem 12. H we 
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Figure 1 . A parallelogram polyomino with 11, left height I = 

2, right height r = 1, width w = 5, and height h = 4. Its contribution 
to the generating function F(q, s, t, x, y) would be q u s 2 tx 5 y A . 

note d = {0, 1}, e(r) = r, fo(r) = 1, and fi(r) = 1, so that: 

F(r, x,q) = J2 x "' q an+1 r K+1 = ^x n ^ ? E?=li V = J^ 1 + fl)"™" 

™>0 J=(j 1 ,...,j n ) n>0 J=(j 1 ,...,j n ) n>0 

i l e{o,i} i l G{'o,i} 
As expected, F(l,x,q) = ^ n>0 (l + q) n x n . Alternatively, because F{r) = j 1 ^ + 
■jz^F(qr), we can expand directly to find the equivalent expression, F(x,q,r) = 



l—x—qx ' 



Example 2.3. Suppose F(s) satisfies F(s) = xe(s) +x/_i(s)F(l) + xfi(s)F(qs), as 
in Equation (II. ip . Theorem 12.11 implies that 

n 

f(s) = Y, x ' n+1 E <i an+lsbn+1 )UM ( i aisbi ^ 

n>0 .! ij< y. i=l 

i l e{-i,i} 

where at is the number of consecutive Is in J ending with entry i — 1 and bi — 1 if 
ji = • ■ ■ = = 1 and 6j = otherwise. 

Example 2.4. A multivariate functional equation with nice symmetry is 

i^O", s) = e(r, s) + x/_i,_i(r, s)F(l, 1) + x/_i,i(r, a)F(l, gs) 

" >J +»/i,_i(r, s)F(qr, 1) +a;/i ) i(r,s)F(gr,gs). 

When solving Equation (12.31) in the form of Equation (12. 2p . the exponents dk,i have 
a simple description. Given a sequence J = (j 1 , . . . , j n ) on the alphabet 

d = {{-i,-i}, {-i,i}, {i,-i}, {i,i}}, 

define Jk = . . . , j^) for A; G {1,2}. The exponent a^i is the number of consecutive 
Is in Jk ending with entry i — 1. 

3. Application: Parallelogram polyominoes 

A parallelogram polyomino (also called a staircase polyomino) is a horizontally 
and vertically convex union of 1 x 1 lattice squares that touches the bottom-left 
and top-right corners of its bounding rectangle. (An example is given in Figure [TJ) 
Parallelogram polyominoes are one of the first classes of polyominoes to have been 
enumerated — Polya [P6169J found the generating function for parallelogram polyomi- 
noes by perimeter and area. One remarkable feature is that the number of parallelo- 
gram polyominoes with perimeter 2n is the Catalan number c n _i. Indeed, Delest and 
Viennot [DV84] give a bijection between parallelogram polyominoes with perimeter 
2n + 2 and Dyck paths of length 2n that at the same time accounts for area. 
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For each parallelogram polyomino P, we can determine its area a, the height of its 
leftmost column I, the height of its rightmost column r, and the width w and height h 
of its bounding rectangle. Mireille Bousquet-Melou [BM96] used a layered approach 
(constructing the polyominoes column by column) to prove that the parallelogram 
polyomino generating function F(q, s,t, x,y) = J2p q a( - p ^s l( - p h r( - p ^x w( ' P ^y h( ' P ^ satisfies 
the functional equation 

F(s) = XStyq + ? ^ ,F(1) + =^ ,F(sq). 

l-styq (1 - sq)(l - syq) ' (1 - sq)(l - syq) 

This is of the form in Equation (11.11) . discussed in Example 12.31 As such, 

E. n a n +i+l „6„+ii„, _"_ n a.i+l J>i 
x n+i y- (_ 1)0 (J)_Q i tJL- TT 1 £ 

n>0 Je{-l,l}« * W i=l V ^ y; 

where the sum is sequences J of length n over the alphabet { — 1,1} and o(J) is the 
number of entries of J equal to 1. Expanding the middle factor and simplifying, 
(3.1) 



F(s) = Yx n+1 y (-1)°^ y {tyq a ^ +1 s K ^) m \\- ^ Q T^f l TTl—^ 

v ' t-^i j-^i v ' u ^ ' 11 i _ a ai+1 s bi )(l — a ai+1 s bi v) 

n>0 Je{-l,l} n m>l i=l K H JK H yj 

n a +1 b 

EE^ m _ (-i)^(yr i+1 ^rn (rr^ r ' 

We conclude that the coefficient of x n+l t m is 



n>Om>l Je{-l,l}" i=l v /V 7 



^ (_l)«(J)( yg aM-i+l fl Wx)mJJ _ g a ' +1 ^ 



Oii+l S 6i)(l - ai+l S 6iy) 

,/e{-i,i} n *=i yy 

Extraction with respect to s or t/ is possible by conditioning on the length of the 
initial run of l's in J. 



4. Application: Affine permutations 

The methods developed in Section [2] provide an alternative to a calculation of 
Hanusa and Jones [IHJIOj . who enumerated fully commutative affine permutations 
by number of inversions. We do not require the theory of affine permutations; we 
prove an equivalent result on (L)(M) (i?)-words. We recall that a permutation w is 
321-avoiding if there do not exist entries i < j < k such that Wi > Wj > Wk- 

Definition 4.1. Let L, M, and R be positive integers. We define an (L)(M) (-R)-word 
to be a 321-avoiding permutation of the set {1, 2, . . . , L + M + R} where the numbers 
{1, . . . , L} are in increasing order, the numbers {L + M + 1, . . . , L + M + R} are in 
increasing order, and every number in the set {1, . . . , L} is to the left of every number 
in the set {L + M + 1, . . . , L + M + R}. 

When the exact value of an integer in a word is of no consequence, we may replace 
integers in {1, . . . , L} with a letter L, integers in {L + 1, . . . , L + M} with the letter 
M, and integers in {L + M + 1, . . . , L + M + R} with the letter R. 
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Let w = W1W2 ■ ■ ■ w n be an (L)(M)(f?)-word. We say that is an inversion if 
i < j and u>, > Wj and we say that w has an M-descent in position i if the i-th M is 
larger than the (i + l)-st M. 

Example 4.2. The (4)(7)(2)-word 

w = 1,2,7,3,8,4,5,10,6,12,9,13,14,11 

may be written llmlmlmmmmmrrm. Note that w is 321-avoiding, has a total of 
11 inversions and has M-descents in positions 2 (8\5), 4 (10 \ 6), and 6 (12 \ 9). 
(Note: the m's are the bolded numbers in the sequence.) 

We define the following combinatorial statistics for an (L)(M)(i?)-word w with at 
least one M-descent. 

• n(w) = L + M + R is the size of the word (marked by variable x). It is also 
helpful to define m{w) = M. 

• l(w) is the number of inversions of w (marked by variable q), 

• a(w) is the number of m's after the last M-descent and before the leftmost R 
(marked by variable r), 

• /3(w) is the number of R's before the last M (marked by variable s), and 

• 7(10) is the number of m's to the right of the leftmost R (marked by variable 
t). 



In Example 14.21 a(w) = 1, (3{w) = 2, and ^(w) = 1. 

Hanusa and Jones [HJ1CH Lemma 3.12] determine the generating function ^2 

x n(w) q l(w) 

for all (L)(M) (R)-words w with at least two M-descents. Their formula requires cal- 
culating coefficients of a generating function that is a quotient of g-Bessel functions 
and subsequently inserting those coefficients into another generating function. In 
Theorem I4.3[ we present an alternative method involving two multivariate functional 
equations. Applying Theorem 12.11 would allow the calculation of an expression for 

J2 x n(w) g l(w) that doeg not 

require the original awkward substitution. 
We recall that the g-binomial coefficient [£] equals - 1 ~^ j ^| rp^i _ g ) + " an d 
enumerates the ways to intersperse k smaller numbers with n — k larger numbers, 
keeping track of the number of inversions incurred using the variable q. 

Theorem 4.3. Suppose L and R are positive integers. Let 

G{x, q, r, s,t) = J2 x m{w) q l{w) r a{w) s^ w) t^ w) 

w 

be the generating function for the (L)(M)(R) -words with at least two M-descents, and 
let G(x, q, r, s, t) = F (x, q, r) + Fi(x, q, r, s, t), where F (respectively Fi) enumerates 
words with zero m's (respectively at least one m) to the right of the leftmost R. Then 
F (x,q,r) satisfies the functional equation 

(4 1) F ( ) ^ ( r ) _j_ xc l r p m x 1 r p t \ 

1 — xr (1 — gr)(l — xr) (l — qr)(l — xr) 

where 



m—l 
m>0 i=l 



L + i 
L 



m—i—l 



k=l 
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MLLMLM N MM N MM .M.M.M.RRRR 

Figure 2. When placing an (M + l)-st M into an (L) (M)(R) -woid 
with at least two M-descents and no m's to the right of the leftmost R, 
the available positions that will not form a 321-pattern are between the 
last M-descent and the leftmost R. 



and Fi(x, q, t, r, s) satisfies the functional equation 



F 1 (r,s,t) = E 1 {r,s,t) + 



x 



(4.2) 



where 



1 — qr 
xt(qs) R+1 
1 — qs 



F 1 {l,s,qt) 



Fx{r,l,t) + 



xqr 
1 — qr 
xt 



Fi(qr,s,qt) 



-Fx(r, qs,t), 



qs 



E 1 (r,s,t)=xt(f2(<l s ) h ) F °(r)+ 

^ 6=1 ' 

EE 1 " 



m>0 i=l 



L + i 
L 





m 




].( 




,-)( 




i 





m—i—l k 



R 



E EE' 

k=l c=l 6=1 



k+b+c— l^k-c^b^c 



b + c-2 
b-1 



Proof. Similar to the proof in [HJlOj . we use West's generating tree method |Wes90j 
to enumerate (L)(M) (i?)-words with at least two M-descents. We fix L and R and 
determine all the ways in which we may insert an (M + l)-st M into an (L)(M)(R)- 
word (incrementing each number larger than L + M by one), keeping track of how 
the combinatorial statistics change in each case. 

When we restrict to enumerating (L)(M) (i?)-words with at least two M-descents 
in which there is no M to the right of an R, there is one contiguous set of positions 
into which we may insert L + M + 1 that does not create a 321-pattern — between the 
rightmost M-descent and the leftmost R. (See Figure [2J) Condition on k, the number 
of m's to the right of where we insert L + M + 1. When k = 0, m(w) and a(w) 
increase by one and l(w) stays the same. As k ranges from 1 to a(w), then m(w) 
increases by one, l(w) increases by k, and a(w) becomes k. From this we see that 
the (L)(M + l)(i?)-words of this type generated from (L)(M)(i?)-words of this type 
have generating function 

y2 x m{ - w)+i q i ^ w) r a{ - w)+i + x H^)+^ q iM+k r k 



w k=l 



a(w) 



xr 



m(w) n l(w) r a(w) 

x m ( w ),, !t "-I ,.<»(«•) 

w 

xrF (r) + 



xr 



r ,q~x~ /r ~s~, _|_ 
xqr 



w 

xqr 



k=l 



F n 1 



- qr 

xqr 



J2x mM q l{w) {l ~ (qr) a{w) ) 



F (qr). 



1 — qr 1 — qr 

We also need to enumerate the (L)(M+ l)(i?)-words of this type that do not arise in 
this way. More specifically, we enumerate (L)(M + l)(i?)-words w such that removing 
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Figure 3. When placing an (M + l)-st M into an (L) (M) (i?)-word 
with at least two M-descents and at least one M to the right of the 
leftmost R, there are two contiguous sets of possible positions. 



the number L + M + 1 (and decrementing each larger element by one) leaves an 
(L)(M)(i?)-word w' with one M-descent and no M to the right of an R. Suppose that 
w n s one M-descent occurs in position i. There are ([^] — l) ways to arrange the 

M-entries in this way and \ L t % ~\ ways to intertwine the l's with the first i m's. We 



then reinsert L + M + 1 to the right the existing M-descent. If there are k m's to the 
left of L + M + 1 (where k ranges from 1 to m — i — 1), then l(w) = l(w') + k and 
a(w) = k. Summing over all m gives Eq{t). 

Combining these new (L)(M + l)(i?)-words with the (L)(M + l)(i?)-words created 
using the generating tree and subsequently solving for F (r) gives Equation (14. ip . 



When there is an M to the right of an R, there are two disjoint contiguous sets of 
positions into which we may insert L + M + 1. (See Figure O) 

First, we may insert L + M + 1 into a position between the rightmost M-descent 
and the leftmost R. Suppose that there are k m's to the right of where we insert 
L + M + 1 and to the left of the leftmost R, where k ranges from to a(w). In this 
case, m(w) increases by one, l{w) increases by k + 7(10), and a{w) becomes k, while 
f3(w) and j(w) remain unchanged. This provides a contribution of 



a(ui) 




w k=0 



a(w) 



= X 



,m(w) ql(w) s P(w) fqf-yiw) 




w k=0 




X 



F(x,q,l,s,qt) 



xqr 



F(x,q,qr,s,qt). 



1 — qr 



1 — qr 



Alternatively, we may insert L + M + 1 into a position after the rightmost M. 
Suppose that there are k r's to the left of where we insert L + M + 1, where k ranges 
from f3(w) to R. In this case, m{w) and j(w) increase by one, l(w) increases by k, 
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a(w) stays the same, and (3(w) becomes k. This provides a contribution of 

R 

w k=f}(w) 

R 

= xt^x m{w) q l{w) r a{w) t^ w) (l s ) k 

w k=0(w) 

— — — — x M'>")^{w) r a{w) t - i {w) //q S y{w) _ ( qs )R+i\ 
1 — qs / — ' 

w 

xt xt(qs) R+1 

-F(x, q, r, qs, t) F(x, q, r, 1, t). 



1 — qs 1 — qs 

We also must enumerate (L)(M + l)(i?)-words w with at least two M-descents and 
at least one M to the right of an R such that removing element L + M + 1 (and 
decrementing each larger element by one) gives an (L) (M) (i?)-word w' that is not in 
this class. This can occur in two ways — either L + M + 1 is the only M to the right 
of the leftmost R in w or L + M + 1 is to the left of the leftmost R and w' has only 
one M- descent. 

In the former case we insert L + M + 1 into any position after the leftmost R 
in an (L)(M) (i?)-word with at least two M-descents and no m's to the right of an 
R. Conditioning on b, the number of r's before L + M + 1, gives a contribution of 
^(Ef=iM 6 )^o(r). 

In the latter case we follow a similar argument to that given for Eo(r), except that 
after placing L + M + 1 to the left of k m's (for a contribution of q k ), we intertwine 
any positive number of R's with between 1 and k m's. If we intertwine b R's with 
c m's, we first pass one R past c m's and one M past 6—1 R's for a contribution of 
q b+c ~ l , and there are [^J^ 2 ] wa Y s to intertwine the remaining m's and R's. With c 
m's to the right of the leftmost R, there are k — c m's after the last M-descent and 
before the leftmost R; this accounts for the r k ~ c s h t c . □ 

Finally, we note that Equation fl4.ll) has the form of Equation (II. ip . which is solved 
in Example 12.31 and that Equation (14.21) is a functional equation of the form 

F(r, s, t) = e(r, s, t)+f^ 1 ^ 1 F(l, s, qt)+fi A1 F(qr, s, qt)+f ,-i, F(r, l,t)+f 0ih0 F(r, qs, t), 

to which Theorem 12 . 1 1 also applies directly. The coefficients of the generating function 
£ x n{w) q l{w) calculated using these functional equations agree with the formula given 
in HTTP) . 
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